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OPP-8 105 7A 1978 
MEMORANDUM FOR: Chief, Audit Staff 
THROUGH : Deputy Director for Administration 
| FROM > Clifford 5. May, Jr. 

nirector of Data Processing 
SUBIECT ; Aetion on eavonmontacion 
REFERENCE : keport of Audit, General Accounting Syste. 


dated 22 March 1978 


Ll. As requested, this nemorandum advises you of the 
action taken on the recommendation contained on page 7 of 
the reference. The recommendation reads: “Review and 
revise the estimating process to increase its accuracy. 

The review should consider inelusion of all cests in the 
astimates and elicitation of more complete initial speci- 
fications from users. Concurrence in the revised precedures 
should be obtained from all Directorates.” 


2, he reference atates that the GAS system “is 
sound and "the actual time and expense incurred does not 
appear to be axcessive.” It is clear that the estimates. 
while wrone, aid not interfere with the successful completion 
of the project, nor did the projact suffer from tack of fands 
er resources Jue to under-estimation. 


4. We share your concern for valid project estinates, 
nd are currently examining ‘4ifferent methods of project 
estination. Review of estimating processes is a gontinual 
task in this Office, both as a geparate activity and as a 

part of overall project review. The leasons learne? in 
estimating the CAS project were apolied in preparing later 
agtimates. Mowevar, estimates are often wrone for reasons 
other than the methods ase’? to sroduce therm. Changes in 
personnel, requirements, and priorities ail mjayed some 
part and had sone impact on the GAS completion fates anc 
gchedule revisions. Certainly the risks of failure in 
estimating are high when an astimator estimates the aprii- 
cation of rasources that he coss not control. Estimates 
for projects with joint responsibilities must be mace 
jointly or by a single executive agent who ia rasponsible 
for the project and all its resources. 
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4. The area of estimating is indeed difficult 
an@ complex not only for us but for the entire ADP 
industry, and we welcome suggestions for improvements 


from your staff or others. We wiil include ffice 
input in our future estimates. 
May, Jr. 
Distribution: 
Original & 1 - Addressee 

2 - DDA 

1 - ODP Registry 

4 - 0/D/oDP 
Ms /oDy EE :caj/9 May 1978 
STATINTL 
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CONFIDENTIAL SECRET 
Yih at 


SUBJECT: 


Action on Recommendation 
PURPOSE OF ACTION: 


Reveal eke Megs 


ACTION OFFICER (Incl, Ext.) 


STATINTL 


REFERENCES: 


Report of Audit, General Accounting System, 
dated 28 March 1978 


RESOURCE PACKAGE & COSTS (If applicable): 


THIS PAPER {S FOR YOUR: 


COMPONENT/ INFORMATION/ APPROVAL/ 
OFFICER COMMENT CONCURRENCE SIGNATURE 


x the other shoe 


oD 
x 


DISCUSSION: 


STATINTL 


Mr. May, 

I had offered to ne with response--so 
that's why I drafted enclosed reply. Dave doesn't really 
address recommendation in reference. Think draft response 


may be flat, but at least answers the reference. 


STATINTL 


th (ee rrmee a 
SIGNATURE OF ACTION OFFICER DAT 
AOD TO'OF L FILE YES NO 
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21 April 1978 


The Audit Report on GAS specifies that Applications 
grossly underestimated both the time and cost necessary 
to implement GAS. To re~cap the events: 


1. May '74 Feasibility Study completed 
2. Oct.'74 New project leader assigned 


3. Nov.'74 Project Proposal completed 
specifying July '75 finish $308,000 


4. April '75 Applications is comfortable about 
specifications - sees July '76 as 
target 


5. Fall '75 Programming finished 
6. Mar.'76 User testing 


7. Oct.'76 Implementation date - picked with start 
of new TQ 


The bottom line on this project was that the Project 
Proposal was developed six months too soon. There were a lot 
of unanswered questions in Nov.'74 when the Proposal came out. 
For example: (1) how transaction codes would be used, 

(2) firm data entry plans, (3) format for the reports, (4) a 
description of how obligations and advances would work, 
(5) specifications and/or allotments and daily closing. 


These issues were resolved between Nov.'74 and April "75. 
It was only at that time that we could make estimates with 
any degree of confidence. We simply should have resisted any 
pressure to "get the system up" and studied the problem six 


more months. STATINTL 


One additional note i  : 
Project Leader in Oct. '74. — Looking back, we shou ave 


postponed the Proposal because he was new and needed the time 
to get the facts. 
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2 8 MAR 1978 
STATINTL 
MEMORANDUM FOR: Deputy Director for Administration 
Director of Finance 
Director of Data Processing 
. THROUGH : Inspector General 
FROM 
Chief, Audit Staff: 
SUBJECT : Report of Audit Appraisal of 
the General Accounting System 
30 November 1977 
1. The report of audit appraisal ée the General Account- 


ing System (GAS) as of 30 November 1977 is attached for your 
review. Please advise us of action taken on the recommendations 
contained in the report. 


2. We wish to express our appreciation for the coopera- 
tion and assistance afforded the auditors by all personnel 
involved in the development of the GAS, 


Attachment: 


As stated 
Distribution: STATINTL 
Orig. - DDA 
1 - D/Fin 
“wt - D/ODP’ 
1 - O/Compt/DCI 
1 - IG 
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-REPORT OF AUDIT APPRAISAL 
General Accounting System 


30 November 1977 
BACKGROUND 


1. The General Accounting System (GAS) is a computer 
application used by the Office of Finance (OF) to maintain 
the official records of the financial operations of the 
Agency. It is designed to automatically perform many of 
the tasks required to produce the general ledgers, financial 
reports, data for budgetary control, and other information 
needed for fiscal management. The system, developed jointly 
by the OF and the Office of Data Processing (ODP), became. 
operational on 1 October 1976 and replaces an outdated 
application in use since the early nineteen sixties. 


2. ‘The effort officially began in February 1974, cven 
though preliminary work prior to then. was done by the OF. 
The feasibility study and the project proposal were completed 
in May and November of 1974, respectively. Total development 
time was thus about three years. 


3. There is no central record of all system development 
costs. We summarized the approximate costs from information 
obtained from the OF and ODP for the pre-implementation 
period, as follows: 


Category — Amount 
Office of Finance Labor - 26.5 man years. 
Office of Data Processing Labor...... oe eb eae 
Office of Data Processing computer 
tine and. hardware oc¢ 23-5 sek oa tie es awe «aA 
TOGAL, CO. 2 “OS CORERs LO 2try soa. eae ey hee daw tt 
4. Costs for continuing system enhancements since 


implementation are not included in the above figures. <A com- 
parison of planned versus actual costs is interesting, since 
“it was originally stated that the project could be completed 
in six to eight months for approximately $300,000*. This 
comparison is discussed further in paragraph 14. 


*The original estimate included only the costs of the ODP. 
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5. The previc.. accounting system was inadequate, 
It lacked flexibili: . adequate controls, and other desirable 


qualities needed to vrovide modern financial support. - For 
this reason, the project proposal included specifications for 
important new system features to correct the prior weaknesses. 
The most outstanding features were specified to: 


- provide computerized data transfer (interface) ** 
with the: 


‘Agency Payroll Systems 


*Contract Information Systen 
(CONIF TIT) 


‘Inventory Control System (ICS) 


-Financial Resources System - Budget 
Control (FRS). 


--~ reject invalid data by the use of edit and 
validation routines 


- post -financial accounts daily to provide more 
current information 


- provide regularly scheduled reports on a 
more timely basis 


- satisfy requests for ad hoc reports in 
4 - 24 hours 


-+ input single line transactions with codes to 
automatically trigger the multiple postings 
to financial accounts 

- utilize modern data base concepts to capture 
and hold, from input of obligations, data for 
subsequent use in related transactions 


- provide a query capability of obligation and 
other data 


- facilitate changes to programs through the use 


of special programming techniques 


**See attachment for a diagram of the Agency's Financial System. 


approvedlfaNMMKad fopil vos GhAIRLIBAE TdORForQor00001-2 


rn meng wt tae -" is werrge 4 ‘ Gis “hi 
Aut. IS divtcbbac ds = [hy “ball ‘Ne oh ULY 
Approved ForBelease 2001/11/08 : CIA-RDP83T0057QR000100100001-2 


a 


~S- 


- autom - the financial closing entries to 
save « asiderable manual effort 


- brea. ihe constraints of the normal eighty 
Characcer limitation for input by the use of 
modern data entry systems, and 


- provide data entry points at key locations. 


These together with other good features, too numerous to 
mention, were successfully incorporated and they contribute 
to a system vastly superior to the former. 


6. Our participation in the project began in late 1974 
and has continued until recently. The audit included an 
examination of plans and other material pertinent to the 
system and tests to verify satisfactory results. The audit 
concentrated on: : 


- test and evaluation of controls. programmed 
to assure adequate data accuracy 


~ test and evaluation of manual procedures to 
verify the existence of adequate manual 
controls 


- evaluation of the plan to test the system and 
participation in the test | 


- participation in the conversion process and 
an evaluation of the results of conversion 


- review and evaluation of the results of 
operations to verify that they were acceptable, 
and 


- review of system documentation. 
7. In addition, we took specialized training in the 
relevant programming languages and system design. We also 
used audit retrieval programs to extract data for verification. 


The progress of the system will continue to be followed and 
reports issued if conditions warrant. 


Approved Figg Release Poqtattios NIGIA-REIRAS THOT sRab YOO 00001-2 


ey tice 


| ADOC AT TS If 
OS eh cee : oh. 
ARPIONE or Release 2001/11/08 : IA-RDP83T00573B000100100001-2 


-4- 
SUMMARY COMMENTS 


8. We have concluded that the GAS is sound.’ Controls: 
and procedures are effective for production of reliable 
results. Some problems remain, but they will be solved by 
the completion of improvements now underway or planned and 
the resolution o€ remaining errors. - 


9. Since system implementation, the Ot has requested 
many improvements, not only to climinate problems, but also 
to incorporate original requirements that were postponed 
until after implementation. These include automation of 
annual closing entries, improvement of controls between files 
to assure agreement of data, and about forty other items at 
30 September 1977. Many of the tasks have been completed, 
but new requirements are continually being added. However, 
these modifications, improvements, and maintenance tasks are 
normal for’ all systems. 


10. A matter deserving mention concerns some GAS data 
not in agreement with related data in the: FRS and elsewhere 
in the GAS itself. Though annoying and persistent, these 
discrepancies are by now not serious nor do they seriously 
affect confidence in the system. Progress is being made to 
resolve the differences and their causes. These discrepancies 
are discussed further in paragraphs 30 through 32. 


11. To avoid delay of the project, the provision for 
history query of general ledger data was postponed until 
after system implementation. As an interim query capability 
for expenditures we provided the OF with several of our 
audit data retrieval programs. We also provided an automated 
capability for reconciling expenditures between the GAS and 
the FRS. The OF itself programmed a history query capability 
for obligations. The job to provide the balance of the query 
requirements for general ledger will soon be completed by 
the ODP. 


12. This report does not offer recommendations in areas 
where satisfactory action is already initiated by either the 
OF or the ODP. The long list of pending enhancements and 
maintenance tasks properly addresses those areas needing 
attention. Management is apprised of these tasks by reports, 
meetings, and other means. 


13. When possible, our recommendations for GAS improve- 
ments, such as controls needed, were given during our parti- 
cipation and included in the system or otherwise satisfactorily 


Auodhieae 
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resolved. This report comments on matters outside the system 
when relevant to the area being audited. Some comments are 
intended to highlight areas needing attention in other and 
future projects. Many matters discussed were beyond the control 
of individuals concerned and we have the advantage of hind- 
sight. ‘The task was difficult, and it was the imagination 

of all that provided the answers to the many problems cn- 
countered. The complex nature of system development is such 
that often more time is needed than originally envisioned and 
costs tend to grow. The recommendations resulting from this 
review are summarized below and detailed in the paragraphs 
indicated, 


Office of Data Processing 


- Review and revise the procedures for project 
proposals to increase their accuracy. Consider 
inclusion of all costs in the proposals and 
elicitation of more compicte iWitiad. specuri* 
cations from users. Obtain concurrence Of vats 
Directorates in revised procedures (paragraphs 
14 through 18). 


Deputy Director for Administration 


- Provide policy and guidance for user offices 
to improve or acquire the skills necessary to 
participate with the ODP in the development and 
maintenance of computer systems (paragraphs 19 
through 21). 


Office of Finance 


- Include financial activity for lapsed appropriations 
in either the GAS or the FRS (paragraphs 22 and 23). 


- Request edits to prevent charging wrong accounts 
with property procurement transactions (paragraphs. 
24 through 26). 


- Review certain account 4221 property procurenent 
expenditures to determine their propriety and con- 
sistency with Headquarters property procedures. 
Make changes deemed necessary in the procedure 
used to compute the accounts payable figure shown 
on the Agency's financial: statements (paragraphs 
27 through 29). 


ore as 
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14. As mentioned previously, the ODP's initial estimates 
of project duration and total costs were not achieved by a 
wide margin.’ Agency management deserves more accurate infor- 
mation about computer related activities. The causes of these 
underestimates are usually many, often unclear, and difttieult 
to rectify. Exceeding estimates is often the case in large: 
projects, but unacceptable as the norm. Our observations 
indicate reasons for the GAS underestimates, and some possi- 
bilities are suggested to reduce recurrence in future efforts. 


Estimates for the %|:: 


team's Development 


1S. We believe that the estimates resulted from ODP's” 
reliance on incomplete user specifications, unfamiliarity 
with development of general ledger systems, and inadequate 
OF participation in the forecasting process. Also, we were 
told of management pressures for timely results which we believe 
may have influenced the estimates. Tor example, the guide- 
line at the time was to finish projects within a year of i 
initiation, and other more subtle pressures. Consequently, 
the project proposal significantly underestimated the time 
and expense required to finish the job. On the other hand, 
the actual’ time and expense incurred does not appear to be. 
excessive. 


16. When the project proposal was written, some of the 
major areas needing further specifications were: 


- the final general ‘ledger design, including 
the needed data elements and the number of 
ledgers involved in the system 


- the transaction codes required, including 
identification of the data elements for con- 
current <input and the elements resident in 
the system 


- the system's interface requirements 


- the system's input requirements, including 
forms. design, identification of related data 
elements and their formats 


- the edits and validations needed, including 
the criteria for rejection of data, the 
text of error messages, and the location 
of the programming logic, and 


-- the requirements for the conversion of the old 


system's data to the new system. 
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17: The OF and the ODP were aware that significant 
specifications were unformulated. Apparently the ODP mis- 
judged the implication of this. The ODP has procedures for 
estimating developmental efforts, but they rely heavily on 
the experience and judgment of the project leaders. Astute 
observations are necessary for estimating, given the divergent 
disciplines and complexitics involved. For example, we learned 
that the OF believed that these systems require substantially 
longer to implement than was estimated. Presumably, this had 
no impact because the information was not solicited nor 
volunteered, and the proposal was accepted. Meaningful 
estimates are impossible when essential information bearing 
on the problem are unacknowledged. ‘Apparently closer rela-' 
tionships are needed between the ODP and users during esti- 
mating to improve the judgments made. Also, the estimates 
only include the costs related to the ODP's responsibilities 
and exclude the user offices' costs. More meaningful estimates 
should include all costs projected for a system's development. 
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18. /Management need not accept continual, major slippages © 
as normal occurrences of systems development. Improvement 
of the estimating process should be an important Agency 
objective. Estimating will be facilitated if it can be 
supported by more complete specifications, increased judg- 
mental input from users, and freed from: other pressures. 
To define and require more complicte specifications 15.ditfti- 
cult, but it should be feasible without being unresponsive 
to users. User management should view such steps as necessary 
to improve the developmental process and avoid misperceptions 
of unresponsiveness by the ODP. However, users must improve 
their computer related skills before closer relationships are 
fully practicable. The need for improved user skills is 
discussed in subsequent paragraphs. 


{ 
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Recommendation for the ODP 
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Review and revise the estimating process to 

‘ increase its accuracy. The review should 

© consider inclusion of all costs in the esti- 
mates and elicitation of more complete initial 
specifications from users. Concurrence in the 

' revised procedures should be obtained from all 

y Directorates. 
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Computer Related Skills 


19. ,User offices need to further improve their computer 
related skills and participate in greater depth with the ODP 
during systems development.and maintenance. The OF has approach- 
ed this through training and organizing a staff for computer 
development activitics. Based on our observations, the OF 


representatives for the GAS project were better prepared than 


most users in the DDA and a highpoint in the cooperation with 
the ODP resulted. The specifications, nevertheless, needed 
improvement. 


20. We have observed similar needs for improved specifica- 
tions in other projects. The problem concerns improving communi- 
cation of needs to the OPP. Users best know the end results to 
be achieved, however, communicating their requirements to the 
data processing specialists requires a higher level of basic 
technical computer knowledge than most users currently possess. 
Increased skills in systems analysis on the part of users can 
do much to solve the problem. Too much development of detail 
specifications is currently expected from the ONP's analysts. 
More accurate written requirements from users would improve Chis 
situation, facilitate project cstimates, and reduce slippages. 
increased efficiency in systems development should result. 


21. Various offices are enhancing their computer related 
skills, but the effort is not uniform and does not receive the 
emphasis it deserves. [ormal cstablishment of offices! objec- 
tives for skills improvement could provide the impetus needed. 
Recruitment policies could stress the importance of hiring 
individuals with existing computer related skills. As the OF 
has done, major user offices should consider establishing staffs 
that concentrate on computer activities. We believe a strong 
effort by DDA management, the ODP, and major user offices should: 
be made .to develop or strengthen computer skills in major user 
offices. This would go a long way toward providing more efficient 
and effective use of computer assets in the Directorate. 


Recommendation for the DDA 


Provide policy and guidance for the development 
or strengthening of the capability within each 
major user office to participate with the ODP 

in the development and maintenance of computer 
systems. ‘The steps necessary to accomplish 

this may require a change in the current recruit- 
ment, personnel management, staffing, and train- 
ing policies within the DDA. 
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Lapsed Appi <riations 


Financial Reporting 


22. The Agcucy's financial system excludes data needed 
for reporting on offices! lapsed appropriations (M Year) financial 
activity. These data were reported at the office level from 
the prior accounting system. The need for this information 
results from the Comptroller's decision to revise the prior pro- 
cedure and report allotment and related data from the GAS only 
as directorate totals. Subsequent adjustments to the FRS to 
accommodate offices' needs for prior years' information apparently 
overlooked M Year, since other years! data are included and 
reported. 


23. Unreported information includes offices’ accumulated 
financial activity, the resulting status of sub-allotments, -and 
other relevant data. Such information is needed by offices to 
control allotments and review accumulated data pertinent to 
their activities. Of course, GAS reports provide similar infor- 
mation as directorate totals. The exclusion of M Year data at 
the office level is contrary to controls accorded other years! 
allotments. The addition of M Year data will strengthen finan- 
cial controls. 
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Provide: for inclusion of financial activity 
for lapsed appropriations within the Agency's 
financial system. This can be accomplished 
in either the GAS or the FRS. 


Procurement Expenditures 


Incorrectly Charged 


24. During our post implementation review we found sig- 
nificant amounts of property procurement expenses charged to | 
wrong accounts. (The errors result from use of incorrect trans- 
action codes and lack of edits to reject such input. A need for 
these edits was overlooked during system development. 


25. Specifically, the errors. 1nvolve recording property 
procurement expenditures in a non-procurement expense account, 
the 4221, rather than in the correct procurement, expense account, 
the 4223, as indicated by the office codes (88 or 98) accompanying 
the transactions. (Expenditures with codes 88 or 98 are 
account 4223 charges, whereas other codes are 4221 charges.) 
An edit in GAS would have rejected these errors. Conversely, 
additional errors involve recording property procurement expendi-- 
tures in the procurement expense account, the 4223, rather 
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than in the non-procurement expense account, the 4221, as indi- 

cated by the office codes (not 88 or 98) accompanying these 
transactions. A second type of edit in GAS would have rejected 

these errors. 


26. After discussions the OF began correcting the errors, 
which are easily found with the new query capability. Additional 
edits can prevent repetition of this situation: and they should 
-be incorporated into appropriate routines as soon as practicable. 

Recommendation for the Office of Finance 


Request edits to prevent charging wrong 
accounts with property procurement transactions.. 


Results of Incorrect Procurement Charges 


27. ‘The practice of charging ccrtain property procurement f 
expenditures to account 4221 for offices other than 88 or 98 ’ 
needs review. This refers to intentional, correctly coded 
charges and not the previously described errors. Since the 


audit was primarily limited to system cxamination, we did not 
explore the possibility that procurement expenditures in account 
4221 may include material subject to Headquarters property pro- 
cedures - the Material Procurement Allotment/Property Requisition- 
ing Authority process (MPA/PRA). The account 4221 reflects 
millions of dollars of Headquarters originated, non cash procure- 
ments charged from the Agency's funds outside the MPA/PRA process. 


28. The effect on the accounting system from such charges 
and from the errors discussed previously is important. Both 
conditions may result in misstatement of accounts payable shown 
on the Agency's. financial statement; the value of account R203 5 
not 4221, has been used in the formula computing the payable 
figure. The upshot is that the Agency's capital position (equity) 
could be wrong to the extent of inconsistencies in the accounts. 


29. There appears to be little need, under current property 
procedures, to charge the Agency's funds to account 4221 for | 
Headquarters originated, non cash procurements. Even if consist- 
ently budgeted, the treatment given these charges appears incon- 
sistent with that given similar charges in the account AGE a - LT 
any case, this situation requires further exploration, The OF 
should resolve the propriety of this apparently dissimilar treat- 
mont of similar activities and its resulting effect on the Agency's 
published financial position. 
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‘Recommendation for the Office of Finance 
oO ee Ce OF FP aimonce 


(a). Review the practice of charging certain 
property procurement expenditures to account 
4221 to determine its propriety and also. its 
consistency with Ileadquarters property pro- 
cedures and (b) make changes deemed necessary 
in the procedure used to compute the accounts 
payable figure shown on the Agency's financial 
statements. 


Agency Financial System Discrepancies 


30. Some differences still cxist in related data between 
the GAS and the FRS and within the GAS itself. Corrective ecf- 
forts have significantly reduced the originally large and 
numerous discrepancies. Most related data are now in agreement, 
the remaining errors are known, and corrective action is con- 
tinuing. The current differences will not effect a breakdown or 
a loss of confidence in the system. 


31. .For example, at 30 November 1977 the following dif- 
ferences exist between the GAS account 4221 expense subsidiary 
and the related expenditures in the FRS: 


Number of ' Fiscal Years Number of 
Offices Effected ' - Effected ' Differences ‘Net Total 
21 ai 28 $64,697 


These discrepancies include both positive and negative amounts 
and range from plus $63,962 to minus $42,376, 


32. The various differences result from programming, con- 
version and other crrors. Corrective action is not completed 
because of the limited human resources available to work on the 
many competing job priorities. Both the OF and the ODP should 
continue their efforts in this area, 


Recommendation for the OF and the ODP 


Continue efforts to resolve existing systems 
differences and their causes. 
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